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with team preparation for teaching.; tlvose dealing with implementation 
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the form was applicable to the te^^ching approach, and that the data 
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other nursing courses using team teaching. A survey of the literature 
is included, and data is organized into tables and graphs. (NHM) 
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■ ABSTRACT 

A student evaluation of instruction instrument applicable to team teaching 
was designed and administered to a pilot group for them to evaluate the nursing 
course that they were enrolled in. Th6 data from the responses was tabulated 
and ratings were made and charted according to outstanding, superior, competent, 
fair, and of les% value. The items on the form related to teaching team prep- 
aration for the course and implementation of the teaching. Alsp included was 
a portion for student conrnents regarding the things that had been done well by 
the teaching team and those thing^ that they felt needed improvement. 

The outcomes of this project indicated that the form was applicable to 
the teaching approach and that the data could be useful in facilitating the 
learning and teaching in other nursing courses using team teaching. The pro- 
ject was an enlightening experience and emphasized that, if property and care- 
fully handled, the student evaluation of instruction could be' a vital force 
in facilitating' learning and teaching. 
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INTRODUCTION 

With reorganization of the Associate Degree Nursing program at Alvin 
Junior College, Alvin, Texas, team teaching was instituted in all five of the 
'nursing courses in the 1973-74 school year. Then, the next year, 1974-75 schpol 
year, the modular approach to teaching was begun in all, of these nursing courses. 

A "student evaluation of instruction" instrument applicable to team 
teaching was needed for the end of the term. May, 1975., to glean student in- 
put for planning purposes for the following year. The "student evaluation of 
instruction" forms which were being used throughout the college were not ap- " 
plicable to the team teaching method since they dealt with personality of in- 
dividual teachers. These forms had been used with the nursing courses for three 
terms but the procedure was too time consuming and costly since it involved 
completing an evaluation for each member of the teaching team. In- the large 
classes, with appVoximately one hundred thirty students and eight members of 
the. teaching team, the process was an administrative ordeal of no value since 
the data which was gathered was not specific enough to utilize to improve quality 
of instruction off ered by the teaching team. 

This study involves designing a "student evaluation of instruction" 
instrument which will aim toward gaining from the students objective feedback 
concerning teaching team preparation for the course, implementation of the teaching 
and the student involvement in the learning. 



BACKGROUND AND SIGNIFICANCE 

Evaluation of Tteaching produces mixed reactions in any college or univ- 
ersity faculty. The teacher cannot help being concerned about his own success 
in teaching and finds that his self-evaluations are colored by his sense of 
other evaluations. The question is of greater urgency today because of some 

of the trends in education. Even though many faculty and students are insistent 

■s 

upon improving the quality of teaching, the question that most concerns the. 
teacher is how discerning, thorough, accurate and fair is the informal and non- 
systematic kind of evaluatioij by gthers that is going to influence his career. 
The situation, as is, gives serious cause for the emotional -impact among teachers 
because the department head and the dean, and even the president in some in- 
stitutions, is usually alert to what is being said about teacyfiing performance 
and uses'the information in future decisions to reappoint, promote, or offer 
tenure.^ 

Evaluation might be called the "sick man" of education. Evaluations 
consume a large portion of the energies of teachers and students and does so 
to the detriment and even t-he distortion of learning.^ 

However, even with dissatisfaction with present evaluation trends and 
techniques, the fact is accepted that evaluation of instruction is essential. 
Regatdless of whether the evaluation is formal or informal, good or adequate, 
it has one thing in coninbn with every other system of feedback. When it has 
been blended into the. background, system of purpose, values, and policies, it 
controls the next step. All our decisions are conditioned by ^perceptions of 
how we are doing in terms of what we hope to do. Instructijfnal diagnosis 



IC. Easton Rothwell, "The Evaluation of One's Teaching," T he Importance 
of Teaching , (New Haven, Conn., The Hazen Foundation, /1967) , p. 56. 

2ciifford F.S. Bedell, "The Evaluation We Ha/e," Evaluatton as Feedback 
and Guide , (Washington, D.C., NEA,, 1967), p. 18. / 

^ . ' I 
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lies at the heart of good teaching. After each bit of evaluative data comes 
in, the teacher should be ajittle more sure of how to proceed next. The 
evaluation should have as its n^ost significant function a constant probing for 
the best way to move forward. ^ 

This is a period of increased. student concern about teaching and of 
determination to make the student voice heard. It is ironic, that while student 
concern is growin, there is less dependence' by administrators today upon 
systematic student ratings in the overall evaluation of teachers than was .true 
at the beginning of the decade. Greater reliance is .placed, upon informal stu- 
dent judgments despite the fact that their use in evaluating teachers may violate 
the rules of scientific sampling and may in many ways be unreliable.'^ 

Despite the fact that instructors sometimes deny the reliability and I 

4 

value of student ratings, evidence from literature, in defense of stWents' 
evaluations, point out that these, when carefully and properly handled pro- 
vide the best criterion of quality of instruction. Research conducted by Rayder 

demonstrates that student ratings of instructors are not substantially related 

1 

to the students' sex, age, grade-point average, or grades previously received 
from the instructor being rated. 

Another writer defends student evaluation, "As for students, they are 
probably reasonably good sources of information when they are asked the right 
questions. Ifi the p,»^esent conditions of academia they are virtually the only 
direct observers. R^iings based on observations can be useful provided com- 



^^Fred T. Wilhelm, ^'Evaluation as Feedback," Evaluation as Fee dback 
and Guide , (Washington, D.C., flEA, 1967), p. 3. 

'^C. Easton Rothwell, "the Evaluation of One's Teaching," The Imp ortance 
of Teaching, (New Haven, Conn., The Hazen Foundation, 1967), p. 57": 

'SMarcia Boyer, "Teacher Evaluation Toward Improving Instruction," To- 
ward Instruc tional Accountability . (Palo Alto, Calif., Westinghouse Learning" 
Corp., 1973), p. 186. , 



patent observers are involved. Students could report on their own degree of 

in^^est^ whether the instructor motivated them to do more than was required. If 

the questions are well phrased, students can probably make pretty good estimates 

of the instructor's effect on them." ^ 

A student writes, "The" existing programs of course and teacher evaluation 

are not effectively improving'^either courses or teachers. Yet student course 

and teacher evaluation programs are encouraging. They represent the first crtK,,^ 

tempt of students on many campuses to'state their intention to force the. in- 

1 , ' . i * • . ■ 

stitutions to confront the problem of student learning. The hundreds of exist- 

\ ■ : " ' * 

ing student course and teacher evaluation programs should be encouraged to 

continue. Sustaining current student interest in their own education is, crucial. 

t ' ■ 

Such programs should be moved as close as possible to decisions regarding cur- 
riculum design and faculty evaluation. 

The survey of literature emphasizes that evaluations are necessary to 
improve the quality of instruction but indicates that present evaluative pro- 
• tedures are not effectively accomplishing this goal. There is a need to find 
out what contribution teaching makes to what the student learns in order to 
have sounder bases for administrative' decisions, to improve the practice. of 
teaching and to jjiave criterion for use in the research which may some day lead 
to a viable theory of instruction. This points to a need for further research. 
Perhaps the works of Cohen and Brawer gould be the proper direct-ion for further 
experimentation. They contend that, although evaluation is often stated to be 
for the purpose of improving instruction, the .methods seldom relate to instruct- 



^John W. Gustad, "Evaluation of TeachiJ)g Performance" Improving College 
Teaching, (Washington, D.C., American Council 'on Ed., 1967), p. 265. 
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7james Johnson, "Instruction From the cirisumers View," Improving College 
Teaching, (Washington, D.C.'Amer. Council on ^d., 1967), p. 2287^ 



ional practicls and even less to results of instruction. They propose that 

\ 

evaluation woupd be more meaningful if it were related to instruction as a 
discipline rather than to the person of the instructor. If the instructor is 
to be observed \s one force in the learning. environment, methods other than 
those^now tj^pical must be employed. More important, the effects of the in- 
"structional process mustjbe included in the evaluation design. They support" 



that student achievement 



of learning objectives is the main criterion on which 



studies of -faculty and instructional effect should.be based. ^ 

Cohen and Brawer ndte that fatuity evaluation may eventually prove ef- 
fective \x\ promoting the development of instructional! specialists* Instructional 
special izclti on suggests team teaching, a practice becoming widespread among 
institutions at all levels o^" education. Team members who do not functioji 
effectively hinder their colleagues who can apply necessary sanctions to force 



them to changfe or to eliminat^, them fr.om the team. jEvaluation then becomes a 
process' by which colleagues influence each others a(!:tivities and eventually 



it becomesvan integral part of the instructional development of the college.^ 

The above is the description of the situation for this study. The 
teaching team is developing and has within ifl:he inherent continuing feedback 
among the members for evaluation and improvement. It is the desire to design 
an effective "student evaluation of instruction" Instrument to utilize further 
feedback from students, or consumers ,\of the instruction. It is thought that 



this is a necessary move toward achievi^ng instructional specialization. 



^Marcia Boyer, "Teaching Evaluatioin Toward Improving Instruction," 
Toward Instructional Accountability , (Palb Alto, Calif., Westinghouse Learning 
Corporation, 1973), p. 187. ' \ 

9Marcia Boyer, "Teacher Evaluation Toward Improving Instruction," 
Toward Instructional Accountability , (Palo 'A1. to, Calif., Westinghouse Learning 
Corp., 1973) p. 187. : 
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. PROCEDURES / 



^ The first step in the procedure for this study was to establish criteria 
fqj" a, design to deliver the feedback that is needed, when it is needed,. to the 
pers!ons or groups who need it. Ffed T. Wil helms in Evaluation as Feedback'and 



Guide furnishes a set of encompassing basic .criteria: - 

1. Evalu^ition must/ facilitate self -evalxjation. 

2. Evaluation must encompass ev^ery objective valued, by the-schoq'l 

3. Evaluation must facilitate j-earning and teaching. 

4- Evaluation must produce records appropriate to the purposes for 

— ' <, 

which records are essential. 

5. Evaluation musf provide continuing feedbapk into the larger question 
of curriculum development ^ind educational policy. 

It becomes obvious thht to jneet. these criteria involves a complex 
evalu^ive system which, in this case, would involve the student, the teachers, 
the teamNjnit, and the administration. For the studen\design, the focus- would 
be on "facilitating learning and teaching," \iwever, the data received from the^ 
students would have an influence on the other listed criteria. ' 

Next the desire to have student input concerning their "attitudes" and 
"feelings" in.regard to their^evaluation of instruction resulted in devising and 
/and administering a questionaire. (Appendix I). This was administered to two 
small group sessions with a total of thirty-one students to provide sampling of 
the larger group. The responses to some qyestions seemed significant to indicate 
that students could offer input to facilitate the effectiveness of team teaching. 
These students were groups in their second year. (jFable 1). 



/ 
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TABLE 1 ' 

PERCENTAGES OF RESPONSES OF 31 STUDENTS 
1 • 



SIGNIFICANT, QUESTIONS 



% Yfes ' % No 



1. 

2: 

• 4. 

9. 
14. 

18. 
23. 

24. 
26. 



A' 



I like to evaluate the courses that I take 



I consider it an opportunity to be asked to evaluate 
a .course or teacher 

I feel-'that we '(the students) are qua! ifiedito\eval' 
uate the quality of instruction ' ^ 

I give--<p great deal of thought to the evaluations 

I think that' I am- better qualified to evaluate the 
"quality of irfstruction" now than when I was in 
my first, year 

I like to write in comments and suggestions on an 
evaluation 

I think evaluations should be done after each unit 
while the material and the teaching approach in still 
cl6ar in my mind ^ ^ 

I think evaluations should be done early in the course 
so that change could occur before the course is over 

I think that the teachers* continuing employment should 
depend on the outcomes of student evaluation of in- 
struction 



94 

94 

90 
87 

84 
77 

87 
74 

54 



6 

6 

10 
13 

16 
23 

13 
26 

61 



r 



The results of the questionaire. which was of significance (Table 1) 
indicated that most of them liked to and considered it an opportunity to eval- 
uate a course or teacher. Most felt that they were qualified to evaluate the 
quality of teaching but felt that they wefe more qualified fp their second year 
(^m their first. A great percentage felt that evaluations could be gTven at^,^ 
•a more advantageous time. Opinions were divided in regard to continuing em- 
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ployrtient for the teachers depending on the outcomes of student evaluation of in- 
struction. With this question some responded with both "yes" and "no." 

The first draft of a student evaluation of instruction was designed. 

/ 

(Appendix II). This, was administered to a pilot group— two small group ses/ 
sions of the larger group. This group consisted of a total of twentfy-seven 
students^. These students wpre instructed to evaluate the course that they 
were now in and when they had finished the evaluation to write. a critique of 
the form on the back of the pagp. 

The critiques that were given were all positive in that most indicated 
that the'^rm was better than those previously used in the college for other 
courses, thgv statements were easy to understand, and the form seemed to in- 
clude everything. The most positive comments were that it was brief and had a 
place for comments./^- 
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RESULTS 

The statements on the opinonaire for student evaluation of instruction 
was divided into three segments: those dealing with team preparation for 
teaching; those dealing with implementation of teaching or what the teaching 
did for the student; and those for student comments dealing with what was 
done well in the course and what should be done to improve. the course. 

This arrangement seemed to lend itself to a method of rating ^eam 
effectiveness. Total responses were totaled tn each of the rating columns; 
outstanding, superior, competent, fair, and of less value. These were divided 
by the total of all the responses to give an overall percentage rating of • 
the team instruction (Figure 1) in each of the rating categories. 

• 

.60 

.50 
.40 
.30 
.20 
.10 

Outstanding Superior Competent Fair L/ess than Fair 
Figure 1. Ratings of team teaching effectiveness by 27 students 

To study evaluation of team preparation for the course from re- 
sponses given by the students, the responses were totaled (Table 2) in this 
segemtn of the evaluation and the ratings made by percentages (Figure 2).- 
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TABLE 2 

DISTRIBUTION OF RESPONSES FROM 27 STUDENTS 



Preparation by teaching team 



Total 



1;' The assignments were definite. , 

2. The objectives were clearly stateji. 

3. The learning activities were rel- 
evant to the subject under study. 

4. Expectations of my participation 

in my own learning was communicated 
clearly. . 

5. Preparation of materials and pres- 
entations was evident. 

6. The test items were a measure of 
the objectives. 

7. The selection of content is rel- 
evant to my future needs. 

Totals 



5 
3 



2 
3 
0 
2 



9 
7 



7 
5 
4 



10 
15 

15 

14 
12 
8 
11 



3 
2 



4 

12 
4 



0 
0 

'2 

1 
3 
.3 



27 
27 

27 

27 
27 
27 
27 



15 46 75 32 11 



189 



Note: In.the above table the rating categories ^re in order: 
l~outstanding; 2— superior; 3— competent; 4— fair; less value. 

.60 
.50 
• .40 
.30 
>20 
.10 



Outstanding Superior Competent Fair Of Less 'Value . 
figure 2. Ratings o{j|eam teaching preparation by 27 students 
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To^study evaluation of implementation of teaching for the course; 
the responses in this segment were totaled (Table 3). and the ratings were 
made by percentages (Figure 3). . ■ . 

TABLE 3 

DISTRIBUTION OF RESPONSES FROM 27 STUDENTS 
TEACHING: The Teaching Team: 12 3 4 5 Total 



8. Interprets abstract ideas and theories 0 4 16 5 2 27 
clearly 

9. Gets me interested in the subject 0 4 14 8 1 27 

10. Has increased my skills in thinking 1 9 10 5 2 27 

11. Has broadened'^my interests 2 9 l^tryZ 1 27 

12. Stresses important material I'j 10 10 5 2 27 

13. '^Makes good use of visual aids ^ 4 " 8 12 2 2 27 

14. Inspires class confidence in 

knowledge of subject 0 3 17 6 1 27 

15. Has given me new viewpoints or 

appreciation 1 , 9 11 5 1 27 

16. is clear and understandable in 

explanations 0 6 12 8 1 p 

' Totals ~9 62 115 46~ll 243~ 

\ \ 



Note: In the above table the rjating j:ategories are in order: 
Column 1-outstanding; 2— superior; 3~compet.ent; 4— fair; 5— 
of less value. ' - * 
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Outstanding Superior Competent 'Fair Of Less Value 

Figure 3* Ratings of the teaching process by the teaching team by 
27 students 

The cormients that were offered by the students in the last seg- 
ment of the opinionaire were very useful. There was general agreement 
that the things that had been done well in the "course, was the selection 
of excellent films and visual aids, the cooperation of the teaching team, 
frequent testing, and-^getting to know more teachers. The things that they 
thoughts,^ld be done better were, as expected, a" need for smaller classes, 
shorter cla^ sessions, and better test items. 

The tabulation of the data from the student opinionaire indicates 
that opinions of any divergent group will fall as a nprmal distribution 
just as will the abilities, but not necessarily to coincide with individual 
scores. This point would require further study. If this could be proved, 
student opinions could be useful as a valuable evaluative tool. Adminis- 
trators and teachers could accept the fact that opinions vary in different 
people depending on who they are, their values and their experiences and 
would vary no matter what occurred in the classroom. Then, opinions which 
fell into a normal distribution could be a normal finding and perhaps a 
positive one. This could relieve the apprehensions among teachers which 
student evaluations seem to produce and the data could be studied to im- 
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prove instruction. The fact that the students are given the opportunity to 
evaluate the teaching could be the imfJietus needed to facilitate learning and 
teaching and far more important than* the outcomes of the data. 
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V RECOMMENDATIONS 

If the opportunity to give the evaluation is the positive point 
in the process, then the student evaluation of instruction shouJd be con- 
sidered as an important part of the course, and this should be conveyed to . 
the student* To do this, the student opinionaire should be handled by the 
teaching team. The procedure and the purpose should be written in the syl- 
labus and discussed with the students at the beginning of the course and a 
schedule time given to it. The teaching team should be allowed to collect 
and interpret the data so the members could have immedi'ate feedback instead 
of knowing of it at some future date, if at all, with others' interpretations. 
This will be recommended to the department head for plans for next year. 

For immediate plans, the opinionaire will be administered to the 
large class in May, 1975. The fly sheet for personal data which is already 
in use at the college will be added to it. This asks for age, sex, race, 
grade-point average, expecteit^ grade in the course, and to ra4e the course 
with other courses. This will give valuable information for further sutdy 
which may be needed by the team to improve instruction. Further study which 
is recommended is to rate the team by all students in the class the compare 
these ratings with those of different age groups, sex, race, and expected 
grades in the course. This could reveal those groups giving the lowest 
ratings and perhaps the teaching appraoches could be modified to make the 
course more meaningful to them. 
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To assist me in a study of "studenO^^^^^ation of instruction," 
please respond to the following questions by circling "yes" or "no." The 
purpose of the questionaire is to get some evidence to describe student "at- 
titudes" or "feelings" regarding c ourse or teacher evaluation. Please an- 
swer the questions as you "honestly feel." No names are necessary. Thank 
you, EH. 

1. I like to evaluate the courses I take. Yes^ No 

2. I consider it an opportunity. to be asked to evaluate a' course or 
teacher. ^ Yes No 

3. I consider the evaluation of my courses a task which is a waste | 
of time. Yes No 

4. I feel that we (the students) are qualified to evaluate the qual- 
ity of instruction. ' ^ , Yes No 

5. I usually give a very good evaluation for the courses that T^ve 

taken. - r Yes No 

6. - 'I am usually very critical of the courses that I am asked to 

evaluate. ^ Yes No 

7. After I. have completed an evaluation I feel good. Yes No 

8. After I have' completed an evaluation I feel bad. Yes No 

9. I give a great deal of thought to. the evaluation. Yes No 

10- My score on the evaluation reflects rny interest in the subject 

and not the "quality of instruction." Yes No 

11. My score on the evaluation is related to the grade I am making 

in the course. ' Yes No 

12.. I like to evaluate a course because\it gives me an opportunity 

to "vent" rny feelings. \ Yes No 

\ 

13. 1 like to^evaluate a'course because i^ gives me an opportunity 

to compliment the instructor. \ . - Yes No 

14. I think that I am better qualified to evaluate the "quality of 
instruction" now than when I was in my first year. Yes No 

15. Evaluating courses is boring for me. Yes No 



18 



16. Evaluating courses takes too much time. Yes No 

17.. I prefer the computer card method of making the evaluation. Yes No 

18. I like to write in comments "and suggestions on an evaluation. Yes No 

19. If the course has required very little work from me, I give a 

good score* Yes No 

20. If I have had to work hard and feel that I have learned a lot, 

I give a^good score. ; - . ^Yes No 

21. The things that I am most critical of in a course that I am 
taking are under administrative control, (scheduling, time, space, 
etc.) ^ ' ' \ \ Yes No 

22. I feel that the teaching-team and administration are responsible^ 
for the quality of instruction and should evaluate it without 
bothering students.^ • Yes No 

23. I think evaluations should be done^ after every unit while the 

material and the teaching approach es still clear in my mind. Yes No 

24. I think evaluations should be done early in the course so that 

change could occur before the course is over. Yes No 

25. I. think that the evaluations should be done during the final week 

of the course. Yes No 

26. I think that the teacher's continuing employment should depend 

on the outcomes of "student evaluation of instruction." Yes 'No • 
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SURVEY OF STUDENT OPINION OF TEACHING 



PREDETERMINED LEARNING:/ Preparation- by teaching team. 

1- The assignments were definite. 

2. \ The objectives were clearly stated. 

3. The learning activities were relevant to the subject 
under study. 

4. Expectations of my participation in my own learning 
was communicated clearly. 

5. Preparation of materials and presentations was evident. 

6. The test items were a measure of the objectives. 

7. The selection of content is relevant to my future-^ 
needs. ^ . 

TEACHING: The teaching team: ' 

8. Interprets abstract idea^, and theories clearly. 

9. Gets fme interested in the subject. 

10. Has increased my skills in thinking. 

11. Has broadened my interests. 

12. Stresses important material . 

13. Makes gqod use of visual aids. 

14. Inspires class^^confidence in knowledge of subject. 

15. Has given me new viewpoints of appreciations. 

16. Is clear and understandable in explanations. 



c 
c 

fO 

CO 
4J 



o 

•r- 

0) 

o. 

3 
CO 



4^ 

c 

0) 
O. 
E 
O 



C 

o 



2 3, 4 
2 3 4 



2 
2 
2 
2 
2 
2 
2 
2 
2 



3 
3 
3 
3 
3 
3 
3 
3 
3 



4 
4 
4 
4 
4 
4 
4 
4 
4 



0) 
3 



(/) 

to 



If- 
O 



2 3 4 5 
2 3 4 5 



5 

5\ 



5 
5 
5 
5 
5 
5 
5 
5 



THE TEACHING TEAM WOULD LIKE TO KNOW IF THERE IS SOMETHING YOU BELIEVE HAS BEEN 
DONE ESPECIALLY WELL IN THE TEACHING OF THE COURSE 

THE TEACHING TEAM WOULD ALSO LIKE TO KNOW.WHAT SPECIFIC THINGS YOU BELIEVE MIGHT 
BE DONE TO IMPROVE TEACHING OF THIS COURSE ^1. 



